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(57) Abstract 

A method for describing the contents of dynamic image data efficiently with a small 
amount of data, including a mechanism in which (1) the trace along which each object moves 
with time is expressed by using a reference plane for expressing the information on the position 
of the object, (2) a description unit based on the type of the motion of the object is provided by 
using the change of the shape of the object, (3) the motion of the object is represented as a 
motion section, and (4) the definition of the object depending on the video contents, the 
definitions of the action types, the definitions of the scene interpretation depending on the 
interaction of the objects are read and interpreted. 
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m^btiztK swfciifca, sum**!-**: 

ttSr y 7 7 WTs • ZfV—V ( Reference plane) fcPftf, ^T<^«t5^ 

}) 7 7 V 1/ X - y V — > ( Reference plane ) „ 9 — > ( Zone 
Description) > # p< 7 (Camera Spec) W|E3i6?:lll7{C^bfCo # 

25 ittSrtlUot, BE^m^O^-^^i^ hO«!*#«#*ef 5, 
n CO Action (XttActil5ifet-5) £ LTi 8 ii tj 5„ 
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ActC'Kick", lO(frame), 240(frame), 3, 3, (120, 180,0) (150, 195, 180) (180, 
223, 230) ) 

5 

£ <D Actions lE&ioT rhZ>*7i?*# h (ft) JoSfcS^EW (V^ 

15 honwiKm^m^Kums mm*?*;** m^sie^ 

Mftt!l^-7*^a:^ h<E>!E5££fTV\ ActionlE 5zK t -T § (13 2) 0 
ZOtt, JrzfV^t h<DQfflmt£&W)*. !)77i^^'7*^y 

S^x* Action ia3?&£#*>, IAction f*. 

25 7*^^^ b^<b£ii£ft$o 
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m-fz> 0 *fc, iAct mm <Dmmm$iKMi>x\*, #-/w>*m#«t/i 

fcfe, fttmS<5V^fi«#§J5aSJiS (1 3 1) o - 

10 -efc2)o 

tints titc&mmmz, w©t^x^hHtfii5, * 

T> AfiaSA^^ffotV^o JBJtio^-^offij&Blfcig 1 <0 1 1 
1 i-^1~ 0 
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W3*ttfrR&B^*5JLfc©#l8 1©*^-* (Space) 123 -C 
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dqkibnu ±tt©H*«[a»fettf^ii*©*fls**«e>"C38<. 

15 ^Oftf^ I D t 7 ^-&m^*&M~t%t£tfX, *<Dffl(D*7i?*? h 
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mK£<ox j f-*tf£.&tf-5imxz>z> 0 
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^-^^^^ htt, [1 2 <DiS/V=. y Y 2 0 1 % 2 0 2 ©R#RS $}$£ik& & 
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H 2(7)2 0 Oft % B#EW(CJ: S^-^^a:^ h^M&IlT*, Obj. 1 
5 ~6 (2 0 3-2 0 8) &j1¥£^U (A) (B) ttf— A«r&L, 
Obj. X (2 0 9) ft, # — & LTV^So 
#~/V2 0 9fi % ftftl D^v^^v^ hi: bT!E$£;ftS 0 
mfLtt, Obj. 2 (A) ft, A^-A©g^*C& *)' % BIEFI2 14 
©Mtt, £oTV^T (run) , Wl2 2 4t1i s Atofc^*f^±L 
10 (s t a y) , B#E^ 2 3 4 T% . #-^Sr«t U (kick), H#EflS 2 
4 4 <9 (run), fl#|2|U3 2 5 4 T*&, tf-^fcife*) (kick 

) , 2 6 4 T'litotV^ (run) 0 r. fl h <D&W)ft\Z, 08 

^tr^k t^i?xn©ffii (Px) 1 1 h^mmtsZo 

Space (123) £ NilOll fcl^ Lfcm^fe 5 tti&b L 

20 -COibt £331 Lfcfc 5 o i30f^(ctt, t^-ff)7^;i/ 

ttmfrmbtltc'&fcs ^3 4 0{CifiVM4g3 1 4~.3iLT^5 0 
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-^^v^ ffi®fc©*^«&Ni$fc#£u ^©#& 

r ft £ Interactive Action (IAction) £ IB j& 1" 5 0 I Action ( X it IAct,IAct t 

111, IAction^lE^OS^tt^^^^^v ; >'{i:M-t-5iiffl^^^(- , t 
10 Sfc*. *M*W»^*5V>TttIAction«:, -fttl. IAction Action {21 <£ 

IAction©f2i£fi, 0 9i§<9 T?fc5 0 
nOIAction%fflV^cl33StO-^^J^T^il«9 ^fc5 0 

15 IAct("Pass", 20(frame), 35(frame), 2, 1, 2 , Trajectory, 2, (120, 180. 0), 
(160, 230, 15) ) 

±^(DIAction6D|53i«, " V>o, ¥ZX\ £ 5 !E3£ 

T*fc£ 0 ±3* ©Action t^Jfc 5 ©tt, *©#«^«#©;*-:/^jc* hT* 

#!£LT\ 2o<Dt^i?x^ Fiaotii#lt^5/U (Pass) 
RXfifa(D*7i/ * 9 h<0iitt'ii§|l5^;V- • (Through 
25 Pass) <Dm.m*WLW~tZ>o 
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15 ^y^nbLx^ hti*bfem-tz>7i"-<nUM 

^-/K^I2^g#(i, ifEO^:/^^ h©Action|B3£*C£>l&f£ I D 
20 ^^B&§ti^o^-^^i^ h I D&#-;l>X&Z>b^5%;%.xnZ£ 0 

^TOeHlIt f-ytf-- a yf ^SM!l*5»t5 IAction Lfck 
(AT*. ^yC^Utt, Action, IAction SrfflWc IE 3£^«T£I 
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*7K-y, 5fc»ifetHHK tr^tfRfc (Video surveillance) ^J&/fl0!l## 
5 ball( StartTime, EndTime, number of Nodes, Trajectory ) 

10 

Activity = { lie, sit, fall_down, raise_hand, dive, hand_throw, throw_in, 
jump, stay, walk, run, sliding, kick, overhead kick } 

Whs ffltlXlfr± (lie) , lotft (sit) , mtlZ (fall_down) 
15 , ¥£^5f 5 (raise_hand) , (dive) , ^> F • ^ P — ( 

handjhrow) % P — ♦ y (throw_in) , *sH/rf (jump) % i.oT 
#± (stay) % #< (walk) s (run) N *7 4*T4l>"!? (sliding) 

s J8fc5 (kick) % Or~'<—^y K • *y * ( overhead_kick) 

20 i^WiLt, /<* (*6<D lf?g~2 6tf g) s PV^'/<* ( 

^6£>28ffS~39ff@) > 7>f-K'/^ (*7(DlftS~14tt 

@ ) , &m'*x 7 <d 1 6 s - 3 3 ft a ) N m^^ (ms(Dinu 

~18*T@) , t>^y^ (m8(D2 0n§~3 8ftS) , M'** ( 
i9© lft@~3 6ftB) tftZftZtlX^Zo 
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5 hm<Dmxfemistix^zmm<Dmmz.<>^xft, mmm&mz&mz 

tlfcW (112, 013, 014, mi 5) 

(11116,12117) 
• 4 0 1 ft, lj^^S4 1 0(D»j;oT, -^ft^tf) 

10 ^^^4 2 o^f-^ii Lxwz-btiz>o mz-ft. fcmmv ttitii 

a*e>flfl#^y:/4 2 2, h<D I Dttfj-^k^v^^ h<Dfl 

©FID (4 2 4) , Wltt&mfrbWlft ID (4 2 6) , ^7^ 5ttf£«7C 
fel^W^7 •^7^M2 8^3dS^t>tl/5o 

15 ia^f-^oir^ wf-^4ou>e)it», A#f-^ti 

20 tfx^ ' * 4 0 1 ll^tfS !)7 7 1/^' ^ 12 j& ( 

Refplane) 4 4 2^#^2), 

i zMwi-ztc&fcmh-ixfem&tix^z, mm*-?!?*? honwi 

7>^&5 ^<£>lt!*tttt£ia3j£ b/c, ^-^!£j#IAct (4 5 6) 
25 kftSo 
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z<Dmm<Dfo%t lt, ' '7 s ' — ^401 o^^^rft o \at, ! 

^a:^^^4 6 0 ft, • *c^-9- R4 7 0 iSTZf '*J x. 

? MS^4 3 0 h V-^!E5&4 5 6^^, *tJ&-f5 If 7*^ • 7*-* 4 0 

^ % V— 4 5 6 te s Refplane4 2 2 & <fc Act 4 3 0 *m 

— 1ff± % i$iyi;y4 6 0l^U ->->IB^IAct4 5 6 K 

10 Refplane4 2 2*5<fct*Act4 3 0 fc&S-f 5^ £ T% zl — ffi©^- ^ 

, H#£ijO*i£5 2 0, tt« (#@ff) <Djf£5 3 0, ^LtiM^5 

.20 ttf£<E>J&j£ff>#£tt, ±^(OAction J ^IAction^^a$i^y^:^l]#5^fflV^ 
5: i#"TIB"e*>So #JtLT#lt (lie) . Iott± (sit) 

* #J*l5 (fall_down) , ^£^{f5 (raise_hand) , ^IfV^ (dive 
) % Ay K • — (hand_throw) % * D — • 4 > (throw_in) x \ 
^•f (jump) % 3ioT#± (stay) % #K (walk) , £6 (run) , *7 

25 -if (sliding) , $E5 (kick) x ir — ^ — ^v K • *t v 9 ( 

overhead_kick) ^ <£> Action-^ > — -fe^U^^^tf) 
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10 ±34©-t5***W«>«^S:«Sra:^J;5 % DVD, CD 

- ROM, MP EG^<DW)W^—#<Dft®*<)>te\,^ — #-&'T*$}S$&}\L 
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5 (a) V 7r \/y* • 

(b) ilufBtbm^-*^©^:/^^ t*&, iftiey ?t • ^ 

10 ££tf!B3£¥IS:o 

(a) y 7r • -7u-i/%mfeirZ>m$kk, 

15 (b) Huianjii-r-^^^^^-y^^^ mmy ?r • 
20 tzmm-tz^gib. 

25 (a) mtd.®w\7 ! -*\z.$-£]nz>*7*jx.* v (D&wmn&m^.'t z> y 
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(b) Y<dM&V 7 7 w^' -f v-v ioi^MW*^* 

(c) htoi&ft&it&m^Xs &*zfi?*f h<Dffife<DW) 

(d) mm*7i?*t h\c£v ^y^it^T^t, 

10 mjlB^m^&fi^ 

15 ( c ) #^-^^1^ h<o^;t«te£J^T. #t^x^ h^m^^ib 

20 ^MtS^Ty^^ 

25 (a) KIBiIf-^^?)!J7rV^^l/-y*^t677yy 
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10 6. »j®^-^C|E52]i^&-efcoTs 

( c) S5l2^^-vy7 B , mjlE^-^^o:^ hyuft I p % huI2I!j^ I DSi; 

(d) ^IS^^-^^^ M^<fcSi^!2$£^Ti/-yfB$£fm^5 
20 ^fy^t, 

7. M^-^lE^Sc-efcoT, 

25 (a) itiiiEib®^-^^^^ ^^a:* hfLJ^I D % ibf^I 
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(b> mt&m^yf, tote*-??** h&m i d, gnssbf^ i drx$ 

5 **ry7k. 

io umbm*-*^ 

(b) mil5«j^lBxE7 f --^T^^$ti^V~^l2^T f -^i, 
15 pr«ft«B»«t#. 

9. (a) mfc®m s f-#Kt*iiz>*7v*9 h<DtiLwmn%m$L't 

20 WiBk LTWS^ry7 , i, 

(c) h<D^«fc£ffl^T, h^F^^^fj 

(d) mjij: 9 ez-y^^lts^fyy^ 
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FIG. 3 
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V 7 7 1^* : (ReferencP nlnt.pl <n& M • 



Reference plane: := Model of the ground (Sr^ffiCO^-x^) 



<Ref ID> 



text 



Name of reference plane 



<Plane> coordinates Center of the Area (e.g. (0,0) ) 

HMD (ffiiofi' (ffllittf (o, 0) ) ) 

<metric> array of numeric define transformation (e. g. 3 X 3 matrix for 

(*rtt«>EJII) Affine transformation) 

V (Zone Descrintin n) CDfR^ : 
Zone Description: := Define meaningful space on the ground 



<Zone ID> text 



Identified the zone on the ground 
(e. g. Goal, Center line) 




define the space on the ground 



ft^V (Camera Sm»^ <n ffi»j» C^2^Ua_kl) : 



Camera Spec: := 



Define camera model 



<Camera Type) text 



Identify camera model 



Param Array> array of numeric define model transformation 

(&fif£>@a?ij) (^-r^ifctf)*^) 



FIG. 7 
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Action:: Describe single player's action 



<Action ID> text 



<T-Interval> time interval 
(WW MM) 



<0bject ID> numeric 

mm 

<Trajectory> Time Stamped Polyline - 



Action Symbol (e. g Run, Kick, Walk, etc) 

Run, K i c k , ft if ) ) 
Time Duration of this action 

(»* <o b»t>v<D&m-vmm ) 

Object Identifier 
(^<75ffijf^&fToT^yh^-y^*^ h) 

Trajectory of the player in this action 
(■t©Mf£&fToTV"»fcll#KIHfcj3tt5 



FIG. 8 
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I Ac t j o n gflj ffift 



IAction::= Meaningful event in the domain, composed of multiple players and ball 



<IAction ID> text 



Event Symbol ( e. g Shot, Pass, 
Through Pass, etc) 



<T-Interval> time interval 



Time duration of this action 



<No of Object> numeric 



Number of objects 



{ObjectID} array of numeric— Array of Objects identifier 



<Space> Trajectory, Spatial description of this action 

Polylines, Polygons {^(D-i ^ h#fTfrftfc»BW>IBi!l9 



FIG. 9 
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I Ac t : 

begin 

IAct£H 

IAct, -?Act, ^balKDMtf ( ^IActir^Act^tt, C <mAct£$$-f SIAct, 
ActSr#*-T5) - 
where 

fill 

[£8TSIActtf>l?3j?ttA«5] 

end 

a mm 
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